Music learning apparatus and music learning method using tactile sensation

ABSTRACT

A tactile music learning apparatus converts sound data of a user&#39;s voice corresponding to original music into first tactile data including tactile information, generates a synchronized tactile pattern by synchronizing the first tactile data with second tactile data including tactile information corresponding to sound data of the original music, and transfers the synchronized tactile pattern to a tactile reproducing apparatus to allow the tactile reproducing apparatus to reproduce the synchronized tactile pattern.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to and the benefit of Korean PatentApplication No. 10-2021-0006643 filed in the Korean IntellectualProperty Office on Jan. 18, 2021, the entire contents of which areincorporated herein by reference.

BACKGROUND (a) Field

The described technology relates to a music learning apparatus and amusic learning method using tactile sensation.

(b) Description of the Related Art

Existing song practice systems or online music learning systems outputsaccompaniment and melody through sound and also output visualinformation of pitch and lyrics, thereby assisting users in singingpractice.

However, when hearing-impaired persons who cannot hear sound or hasrelatively weak sound recognition use such systems, they have difficultyin learning the melody of the song because it is difficult to match thepitch of the song with the pitch of their own voices. Therefore, thehearing-impaired persons do not enjoy the advantage of online musiclearning that can independently learn music.

SUMMARY

Some embodiments may provide a music learning apparatus and a musiclearning method using tactile sensation, capable of learning musicthrough tactile sensation.

According to an embodiment, a music learning apparatus using tactilesensation may be provided. The music learning apparatus using tactilesensation may include a memory configured to store one or moreinstructions and a processor configured to execute the one or moreinstructions. The processor, by executing the one or more instructions,may convert sound data of a user's voice corresponding to original musicinto first tactile data including tactile information, generate asynchronized tactile pattern by synchronizing the first tactile datawith second tactile data including tactile information corresponding tosound data of the original music, and transfer the synchronized tactilepattern to a tactile reproducing apparatus to allow the tactilereproducing apparatus to reproduce the synchronized tactile pattern.

In some embodiments, in response to the original music not including thesecond tactile data, the processor may convert the sound data of theoriginal music into the second tactile data.

In some embodiments, the processor may receive the original musicincluding the second tactile data.

In some embodiments, the tactile information of the first tactile datamay correspond to a pitch of the sound data of the user's voice.

In some embodiments, the processor may extract a main melody from thesound data of the user's voice and extract the pitch from the mainmelody.

In some embodiments, the processor may convert the main melody intofrequency information and extract the pitch based on frequency analysisof the frequency information.

In some embodiments, the processor may generate the synchronized tactilepattern including a tactile pattern corresponding to the first tactiledata to be reproduced at a first position of the tactile reproducingapparatus and a tactile pattern corresponding to the second tactile datato be reproduced at a second position of the tactile reproducingapparatus, in response to a pitch of the sound data of the originalmusic not matching a pitch of the sound data of the user's voice.

In some embodiments, the processor may generate the synchronized tactilepattern including a tactile pattern to be reproduced at a singlelocation of the tactile reproducing apparatus, in response to the pitchof the sound data of the original music matching the pitch of the sounddata of the user's voice.

In some embodiments, an intensity of the tactile pattern to bereproduced in response to the pitch of the sound data of the originalmusic matching the pitch of the sound data of the user's voice may begreater than an intensity of the tactile pattern to be reproduced inresponse to the pitch of the sound data of the original music notmatching the pitch of the sound data of the user's voice.

In some embodiments, the tactile pattern may be reproduced by vibrationin the tactile reproducing apparatus.

According to another embodiment, a music learning method using tactilesensation performed by a computing device may be provided. The musiclearning method using tactile sensation includes receiving sound datacorresponding to original music from a user, converting the sound dataof the user into first tactile data including tactile information,generating a synchronized tactile pattern by synchronizing the firsttactile data with second tactile data including tactile informationcorresponding to sound data of the original music, and transferring thesynchronized tactile pattern to a tactile reproducing apparatus to allowthe tactile reproducing apparatus to reproduce the synchronized tactilepattern.

In some embodiments, the music learning method using tactile sensationmay further include converting the sound data of the original music intothe second tactile data in response to the original music not includingthe second tactile data.

According to yet another embodiment, a tactile music producing apparatusincluding a memory configured to store one or more instructions and aprocessor configured to execute the one or more instructions. Theprocessor, by executing the one or more instructions, may extract apitch from sound data of music content, convert the pitch into tactiledata including tactile information, and synchronize the sound data andthe tactile data to generate tactile music data.

According to some embodiments, since music content and a user's voiceare synchronized and transferred as tactile sensation, hearing-impairedpersons can practice music even if they cannot hear the music or theirown voices.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing an example of a tactile music systemaccording to an embodiment.

FIG. 2 is a block diagram showing an example of a tactile music learningapparatus according to an embodiment.

FIG. 3 is a block diagram showing an example of a sound to tactileconverter in a tactile music learning apparatus according to anembodiment.

FIG. 4 is a drawing showing an example of tactile music data generatedby a tactile music learning apparatus according to an embodiment.

FIG. 5 and FIG. 6 are diagrams showing examples of reproduction of atactile pattern in a tactile reproducing apparatus according to anembodiment.

FIG. 7 is a block diagram showing an example of a tactile musicproducing apparatus according to an embodiment.

FIG. 8 is a diagram showing an example of tactile music data generatedby a tactile music producing apparatus according to an embodiment.

FIG. 9 is a block diagram showing an example of a tactile reproducingapparatus according to an embodiment.

FIG. 10 is a flowchart showing an example of a tactile music learningmethod according to an embodiment.

FIG. 11 is a diagram showing an example of a computing device accordingto an embodiment.

DETAILED DESCRIPTION OF THE EMBODIMENTS

In the following detailed description, only certain example embodimentsof the present invention have been shown and described, simply by way ofillustration. As those skilled in the art would realize, the describedembodiments may be modified in various different ways, all withoutdeparting from the spirit or scope of the present invention.Accordingly, the drawings and description are to be regarded asillustrative in nature and not restrictive. Like reference numeralsdesignate like elements throughout the specification.

As used herein, the singular forms “a”, “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise.

The sequence of operations or steps is not limited to the orderpresented in the claims or figures unless specifically indicatedotherwise. The order of operations or steps may be changed, severaloperations or steps may be merged, a certain operation or step may bedivided, and a specific operation or step may not be performed.

FIG. 1 is a block diagram showing an example of a tactile music systemaccording to an embodiment.

Referring to FIG. 1, a tactile music system 110 includes a tactile musiclearning apparatus 110 and a tactile reproducing apparatus 120.

The tactile music learning apparatus 110 converts sound of music contentand sound of a user's voice into tactile data, respectively, andsynchronizes the tactile data converted from the sound of the musiccontent and the tactile data converted from the sound of the user'svoice to generate a tactile pattern. The tactile music learningapparatus 110 may receive the music content from various music sources.For example, the tactile music learning apparatus 110 may receive themusic content from a music source, for example, a music or videostreaming service, or may receive the music content directly from a user130. In some embodiments, the tactile music learning apparatus 110 mayreceive sound of a musical instrument played by the user instead of theuser's voice.

In some embodiments, the tactile music learning apparatus 110 mayreceive tactile music including tactile data. To this end, the tactilemusic system 110 may further include a tactile music producing apparatus140. The tactile music producing apparatus 140 may compose tactile musicby converting sound of the existing music content into tactile data orby producing new music using tactile sensation. The tactile musicproducing apparatus 140 may produce educational content using thetactile music. In tactile music, tactile data may be synchronized withsound data.

The tactile reproducing apparatus 120 transfers the tactile patterngenerated by the tactile music learning apparatus 110 to the user 130.In some embodiments, the tactile reproducing apparatus 120 may transferthe user's voice to the tactile music learning apparatus 110. In someembodiments, various including a vibration actuator and a microphone maybe used as the tactile reproducing apparatus 120.

FIG. 2 is a block diagram showing an example of a tactile music learningapparatus according to an embodiment.

Referring to FIG. 2, a tactile music learning apparatus 200 includessound to tactile converters 210 and 220 and a tactile patternsynchronizer 230.

The sound to tactile converter 210 converts sound data of music contentinto tactile data in real time, and the sound to tactile converter 220converts sound of a user's voice into tactile data in real time. In someembodiments, the tactile data may be information indicating a tactilesensation corresponding to a pitch of the sound. In some embodiments,the tactile data may be a tactile pattern. In some embodiments, thetactile pattern may be a pattern distinguished by a frequency, drivinginterval or intensity of vibration. Accordingly, since different pitchesare converted into different tactile data, corresponding pitches may bediscriminated by the tactile data. The tactile pattern synchronizer 230generates a synchronized tactile pattern by synchronizing the tactiledata converted in real time by the sound to tactile converter 210 withthe tactile data converted in real time by the sound to tactileconverter 220.

The sound to tactile converter 210 may convert sound data withouttactile information received from a sound source to generate the tactiledata corresponding to the pitch of the sound. In some embodiments, thesound source may include, for example, music files in various formats,or sound data from a video or music streaming service. The sound totactile converter 220 may convert the sound of a user's voice, forexample, received through a microphone to generate the tactile datacorresponding to the pitch of the sound. The tactile patternsynchronizer 230 may synchronize the tactile data of original sound(i.e., the sound of the music content) and the tactile data of the soundof the user's voice in real time.

In some embodiments, the tactile music learning apparatus 200 maydirectly receive tactile music of the music content instead of the musiccontent. For example, the tactile music learning apparatus 200 mayreceive the tactile music produced by the tactile music producingapparatus 120 to be described with reference to FIG. 1. In this case,the tactile music in which tactile data may be synchronized with sounddata may be provided. Accordingly, the tactile pattern synchronizer 230may synchronize the tactile data provided from the tactile musicproducing apparatus 120 with the tactile data of the sound of the user'svoice based on the sound data. In this case, the acoustic-tactileconversion unit 210 does not need to convert the tactile music producedby the tactile music producing apparatus 120 into the tactile dataagain.

FIG. 3 is a block diagram showing an example of a sound to tactileconverter in a tactile music learning apparatus according to anembodiment, and FIG. 4 is a drawing showing an example of tactile musicdata generated by a tactile music learning apparatus according to anembodiment. FIG. 5 and FIG. 6 are diagrams showing examples ofreproduction of a tactile pattern in a tactile reproducing apparatusaccording to an embodiment.

Referring to FIG. 3, a sound to tactile converter 300 includes a soundbuffer 310, a melody extractor 320, a frequency converter 330, a pitchextractor 340, and a tactile pattern mapper 350.

The sound buffer 310 stores sound data, which are sequentially inputted,for a predetermined time. In some embodiments, since a delay betweensound and tactile sensation is determined based on the predeterminedtime, the predetermined time may be determined to a level that the userdoes not feel much. For example, the predetermined time may bedetermined within 20 ms.

The melody extractor 320 extracts a main melody by removing noise oraccompaniment from the sound data stored in the sound buffer 310. Amethod for extracting the melody may be selected from various knownmethods, and an embodiment is not limited to the method for extractingthe melody.

The frequency converter 330 converts the melody extracted from the sounddata into frequency information through Fourier transform. In someembodiments, the frequency converter 330 may convert the melody intofrequency information through a fast Fourier transform (FFT). The pitchextractor 340 extracts the main pitch through frequency analysis of thefrequency information converted by the frequency converter 330.

The tactile pattern mapping unit 350 maps tactile data corresponding toa pitch extracted from each sound data to corresponding sound data, andstores the mapped data as tactile music data. In some embodiments, aplurality of tactile data respectively corresponding to a plurality ofpitches may be predetermined and stored. In this case, the tactilepattern mapper 350 may select tactile data corresponding to theextracted pitch from among the plurality of tactile data, and map theselected tactile data to the corresponding sound data.

In some embodiments, when music content or a user's voice is serializedinto a plurality of sound data (sound[1], sound[2], . . . , sound[n]),tactile music data 400 may be formed as shown in FIG. 4. That is, eachsound data sound[i] may be mapped with corresponding tactile datatactile[i]. In some embodiments, as described above, the tactile datatactile[i] may be generated with a delay of a predetermined time txcompared to the sound data tactile[i] which is inputted in real time.

Referring to FIG. 2 again, the tactile pattern synchronizer 230generates synchronized tactile data, i.e., a synchronized tactilepattern, by synchronizing tactile data of the sound of the music contentand the tactile data of the sound of the user's voice. The tactilepattern synchronizer 230 may design a synchronized tactile pattern sothat the user can easily determine whether the pitch of the musiccontent, i.e., the pitch of the original sound matches the pitch of hisor her own voice. Accordingly, the user can determine whether the pitchof the original sound matches the pitch of the user's voice, based onthe tactile pattern (e.g., vibration pattern) reproduced by the tactilereproducing apparatus in response to the synchronized tactile pattern.In some embodiments, when the pitch of the original sound does not matchthe pitch of the user's voice, in order for the user to distinguish thepitches, the synchronized tactile pattern may be generated such that thetactile pattern of the original sound and the tactile pattern of theuser's voice are respectively reproduced. In some embodiments, when thepitch of the original sound matches the pitch of the user's voice, thesynchronized tactile pattern may be generated such that a single tactilepattern is reproduced. In some embodiments, when the pitch of theoriginal sound matches the pitch of the user's voice, the intensity maybe increased in the single tactile pattern reproduced when the pitch ofthe original sound matches the pitch of the user's voice.

For example, as shown in FIG. 5 and FIG. 6, a glove-type apparatus maybe used as a tactile reproducing apparatus 500. When the pitch of theoriginal music does not match the pitch of the user's voice, as shown inFIG. 5, the tactile pattern of the original sound is reproduced at alocation 510 which is designated as the original sound in the tactilereproducing apparatus 500, and the tactile pattern of the user's voicemay be reproduced at a location 520 which is designated as the user'svoice in the tactile reproducing apparatus 500. When the pitch of theoriginal sound matches the pitch of the user's voice, as shown in FIG.6, the single tactile pattern may be reproduced at one location 530 inthe tactile reproducing apparatus 500. The position 530 at which thesingle tactile pattern is reproduced may be a position different fromthe positions 510 and 520 designated as the original sound and theuser's voice, or may be any one of the two positions 510 and 520.

Accordingly, the user can determine how the pitch of the user's voice isdifferent from the pitch of the original music. The single tactilepattern can be reproduced when the pitch of the user's voice is matchesthe pitch of the original sound. Accordingly, when the user sings intune, the user can feel strongly only the single tactile pattern and canrecognize the song as good.

FIG. 7 is a block diagram showing an example of a tactile musicproducing apparatus according to an embodiment, and FIG. 8 is a diagramshowing an example of tactile music data generated by a tactile musicproducing apparatus according to an embodiment.

Referring to FIG. 7, a tactile music producing apparatus 700 includes asound to tactile converter 710, a sound to tactile synchronizer 720, anda database 730.

The sound to tactile converter 710 extracts a pitch from sound data ofmusic content and converts the extracted pitch into correspondingtactile data. In some embodiments, the music content may include a musicfile or sheet music, or the like. In some embodiments, the sound totactile converter 710 may operate similarly to the sound to tactileconverter described with reference to FIG. 3, except that it is notnecessary to convert the sound data into the tactile data in real time.In some embodiments, since it is not necessary to convert the sound datainto the tactile data in real time, the sound to tactile converter 710may extract the pitch from the sound data of the music content by usinga precise algorithm.

The sound to tactile synchronizer 720 synchronizes the generated tactiledata with the sound data of the music content, and stores thesynchronized data in the database 730 as tactile music data. The soundto tactile synchronizer 720 may synchronize a time point of the soundwith a time point of tactile sensation. In some embodiments, when amusic file is serialized into a plurality of sound data (sound[1],sound[2], . . . , sound[n]), tactile music data 800 may be formed ashown in FIG. 8. That is, each sound data sound[i] may be mapped withcorresponding tactile data tactile[i]. In this case, unlike thereal-time sound to tactile conversion described with reference to FIG.4, the tactile data tactile[i] may be accurately mapped with the sounddata sound[i] without a delay.

In some embodiments, the tactile music producing apparatus 700 mayprovide a producing tool 740 to directly compose and provide musiccontent suitable for learning tactile music. It is possible to generatea new tactile sound that does not exist in the past through theproducing tool 740. In this case, the sound to tactile conversion may beperformed based on the sheet music without converting the sound datainto the tactile data. The tactile music stored in the database 730 maybe provided at the request of the tactile music learning apparatus.

In some embodiments, the tactile music producing apparatus 700 mayfurther include an educational content producer 750. The educationalcontent producer 750 may provide an interface through which a musiceducator can compose educational content by using the tactile musicstored in the database 730. For example, a music teacher may composemusic of a music curriculum at a corresponding grade level aseducational content for hearing-impaired persons and provide theeducational content to the hearing-impaired persons.

In some embodiments, the tactile music producing apparatus 700 may beconnected to a tactile music learning apparatus through a communicationinterface.

FIG. 9 is a block diagram showing an example of a tactile reproducingapparatus according to an embodiment.

Referring to FIG. 9, a tactile reproducing apparatus 900 includes amicrophone 910, a vibration actuator 920, and a controller 930.

The microphone 910 is provided to obtain a user's voice data to beprovided as an input of a tactile music learning apparatus. In someembodiments, the tactile reproducing apparatus 900 may use an externalmicrophone without including the microphone 910. For example, when themicrophone is attached to the tactile music learning apparatus, themicrophone of the tactile music learning apparatus may be used. Further,a separate microphone may be connected to the tactile music learningdevice.

The controller 930 controls the vibration actuator 920 in response tothe synchronized tactile pattern provided by the tactile music learningapparatus. The vibration actuator 920 generates vibration correspondingto a synchronized tactile pattern under the control of the controller930.

The tactile reproducing apparatus 900 shown in FIG. 9 is an example, andan embodiment is not limited thereto, and various tactile reproducingapparatuses capable of reproducing a tactile pattern may be used.

In some embodiments, the tactile reproducing apparatus 900 may beconnected to a tactile music learning apparatus through a communicationinterface. In some embodiments, the tactile reproducing apparatus 900may be included in the tactile music learning apparatus.

Next, a method of learning tactile music according to embodiments isdescribed with reference to FIG. 10.

FIG. 10 is a flowchart showing an example of a tactile music learningmethod according to an embodiment.

Referring to FIG. 10, a tactile music learning apparatus may convertsound data of original music into tactile data at step S1020. In someembodiments, when the original music is tactile music including thetactile data, the tactile music learning apparatus may not perform theprocess S1020 of converting the sound data of the original music intothe tactile data. In some embodiments, the tactile music learning maydetermine whether the original music is the tactile music including thetactile data at step S1010, and then determine whether to perform theprocess S1020 of converting the sound data of the original music intothe tactile data, based on the determination result. Further, thetactile music learning apparatus receives sound of a user's voice fromthe user at step S1030, and converts sound data of the user's voice intotactile data at step S1040.

The tactile music learning apparatus generates a synchronized tactilepattern by synchronizing the tactile data of the original music with thetactile data of the user's voice at step S1050. The tactile musiclearning apparatus transfers the synchronized tactile pattern to atactile reproducing apparatus, and the tactile reproducing apparatusreproduces the synchronized tactile pattern at step S1060.

Next, examples in which a tactile music system according to variousembodiments is used are described.

For example, content of a tactile music system may be provided throughan Internet protocol television (IPTV) network. In this case, a tactilemusic learning apparatus may be mounted in an IPTV set-top box, andsound data of tactile music produced by a tactile music producingapparatus can be reproduced through a television. The tactile musiclearning apparatus mounted in the set-top box may convert the sound dataof the user's voice into tactile data, and synchronize the convertedtactile data with the tactile data of the tactile music produced by thetactile music producing apparatus to generate a tactile pattern.Further, a function of the tactile reproducing apparatus may be mountedin a remote controller, and the tactile pattern may be reproducedthrough the remote controller. Accordingly, it is possible to provide amusic learning environment at home to a hearing-impaired person.

As another example, a karaoke system or a karaoke application of asmartphone may be used. In this case, a function of the tactile musiclearning apparatus may be installed in the karaoke system or thesmartphone, and a function of the tactile reproducing apparatus may beinstalled in the microphone. Then, the tactile music learning apparatusmay convert existing music content and sound data of a user's voicereceived through a microphone into tactile data to generate asynchronized tactile pattern, and reproduce the tactile pattern throughthe microphone. Accordingly, it is possible to build a karaoke systemthat the hearing-impaired person can enjoy.

As yet another example, a tactile music system may be used in a musicclass for the hearing-impaired person. In this case, educational contentmay be produced from sheet music of a music curriculum through a tactilemusic producing apparatus, and a function of the tactile music learningapparatus may be mounted in a smartphone. Then, the hearing-impairedperson can perform the music class without a special teacher by usingthe tactile music learning apparatus and a tactile reproducingapparatus. Further, instead of the user's voice, performance sound of amusical instrument played by the hearing-impaired person may be used asthe sound data.

As still another example, a tactile music system can be used in culturalprojects for the hearing-impaired person. In this case, a tactile musicproducing apparatus may reproduce tactile music from music content usedin a performance or music content used in a movie, and a function of thetactile music learning apparatus may be installed in a smartphone. Then,the hearing-impaired person can feel the music as tactile sensation byusing the tactile music learning apparatus and a tactile reproducingapparatus.

Next, an example computing device for implementing a tactile musiclearning apparatus or a tactile music learning method according toembodiments is described with reference to FIG. 11.

FIG. 11 is a diagram showing an example of a computing device accordingto an embodiment.

Referring to FIG. 11, a computing device includes a processor 1110, amemory 1120, a storage device 1130, a communication interface 1140, anda bus 1150. The computing device may further include other generalcomponents.

The processor 1110 control an overall operation of each component of thecomputing device. The processor 1110 may be implemented with at leastone of various processing units such as a central processing unit (CPU),a microprocessor unit (MPU), a micro controller unit (MCU), and agraphic processing unit (GPU), or may be implemented with a parallelprocessing unit. Further, the processor 1110 may perform operations on aprogram for executing a tactile music learning method, functions of atactile music learning apparatus, or functions of a tactile musicproducing apparatus described above.

The memory 1120 stores various data, instructions, and/or information.The memory 1120 may load a computer program from the storage device 1130to execute the tactile music learning method, functions of the tactilemusic learning apparatus, or functions of the tactile music producingapparatus. The storage device 1130 may non-temporarily store theprogram. The storage device 1130 may be implemented as a non-volatilememory.

The communication interface 1140 supports wireless communication of thecomputing device.

The bus 1150 provides a communication function between components of thecomputing device. The bus 1150 may be implemented as various types ofbuses such as an address bus, a data bus, and a control bus.

The computer program may include instructions that cause the processor1110 to perform the tactile music learning method, the functions oftactile music learning apparatus, or the functions of the tactile musicproducing apparatus when loaded into the memory 1120. That is, theprocessor 1110 may perform the tactile music learning method, thefunctions of tactile music learning apparatus, or the functions of thetactile music producing apparatus by executing the instructions.

The tactile music learning method, the functions of tactile musiclearning apparatus, or the functions of the tactile music producingapparatus may be implemented as a computer-readable program on acomputer-readable medium. In some embodiments, the computer-readablemedium may include a removable recording medium or a fixed recordingmedium. In some embodiments, the computer-readable program recorded onthe computer-readable medium may be transmitted to another computingdevice via a network such as the Internet and installed in anothercomputing device, so that the computer program can be executed byanother computing device.

While this invention has been described in connection with what ispresently considered to be practical embodiments, it is to be understoodthat the invention is not limited to the disclosed embodiments, but, onthe contrary, is intended to cover various modifications and equivalentarrangements included within the spirit and scope of the appendedclaims.

What is claimed is:
 1. A tactile music learning apparatus comprising: amemory configured store one or more instructions; and a processorconfigured to, by executing the one or more instructions: convert sounddata of a user's voice corresponding to original music into firsttactile data including tactile information; generate a synchronizedtactile pattern by synchronizing the first tactile data with secondtactile data including tactile information corresponding to sound dataof the original music; and transfer the synchronized tactile pattern toa tactile reproducing apparatus to allow the tactile reproducingapparatus to reproduce the synchronized tactile pattern.
 2. The tactilemusic learning apparatus of claim 1, wherein the processor is configuredto convert the sound data of the original music into the second tactiledata in response to the original music not including the second tactiledata.
 3. The tactile music learning apparatus of claim 1, wherein theprocessor is configured to receive the original music including thesecond tactile data.
 4. The tactile music learning apparatus of claim 1,wherein the tactile information of the first tactile data corresponds toa pitch of the sound data of the user's voice.
 5. The tactile musiclearning apparatus of claim 4, wherein the processor is configured toextract a main melody from the sound data of the user's voice, andextract the pitch from the main melody
 6. The tactile music learningapparatus of claim 5, wherein the processor is configured to convert themain melody into frequency information, and extract the pitch based onfrequency analysis of the frequency information.
 7. The tactile musiclearning apparatus of claim 1, wherein the processor is configured togenerate the synchronized tactile pattern including a tactile patterncorresponding to the first tactile data to be reproduced at a firstposition of the tactile reproducing apparatus and a tactile patterncorresponding to the second tactile data to be reproduced at a secondposition of the tactile reproducing apparatus, in response to a pitch ofthe sound data of the original music not matching a pitch of the sounddata of the user's voice.
 8. The tactile music learning apparatus ofclaim 7, wherein the processor is configured to generate thesynchronized tactile pattern including a tactile pattern to bereproduced at a single location of the tactile reproducing apparatus, inresponse to the pitch of the sound data of the original music matchingthe pitch of the sound data of the user's voice.
 9. The tactile musiclearning apparatus of claim 8, wherein an intensity of the tactilepattern to be reproduced in response to the pitch of the sound data ofthe original music matching the pitch of the sound data of the user'svoice is greater than an intensity of the tactile pattern to bereproduced in response to the pitch of the sound data of the originalmusic not matching the pitch of the sound data of the user's voice. 10.The tactile music learning apparatus of claim 1, wherein the tactilepattern is produced by vibration in the tactile reproducing apparatus.11. A tactile music learning method performed by a computing device, themethod comprising: receiving sound data corresponding to original musicfrom a user; converting the sound data of the user into first tactiledata including tactile information; generating a synchronized tactilepattern by synchronizing the first tactile data with second tactile dataincluding tactile information corresponding to sound data of theoriginal music; and transferring the synchronized tactile pattern to atactile reproducing apparatus to allow the tactile reproducing apparatusto reproduce the synchronized tactile pattern.
 12. The method of claim11, further comprising converting the sound data of the original musicinto the second tactile data in response to the original music notincluding the second tactile data.
 13. The method of claim 11, whereingenerating the synchronized tactile pattern includes generating thesynchronized tactile pattern including a tactile pattern correspondingto the first tactile data to be reproduced at a first position of thetactile reproducing apparatus and a tactile pattern corresponding to thesecond tactile data to be reproduced at a second position of the tactilereproducing apparatus, in response to a pitch of the sound data of theoriginal music not matching a pitch of the sound data of the user'svoice
 14. The method of claim 13, wherein generating the synchronizedtactile pattern includes generating the synchronized tactile patternincluding a tactile pattern to be reproduced at a single location of thetactile reproducing apparatus, in response to the pitch of the sounddata of the original music matching the pitch of the sound data of theuser's voice.
 15. The method of claim 14, wherein an intensity of thetactile pattern to be reproduced in response to the pitch of the sounddata of the original music matching the pitch of the sound data of theuser's voice is greater than an intensity of the tactile pattern to bereproduced in response to the pitch of the sound data of the originalmusic not matching the pitch of the sound data of the user's voice. 16.A tactile music producing apparatus comprising: a memory configured tostore one or more instructions; and a processor configured to, byexecuting the one or more instructions: extract a pitch from sound dataof music content; convert the pitch into tactile data including tactileinformation; and synchronize the sound data and the tactile data togenerate tactile music data.